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Abstract: This article discusses different non contact 3D measuring strategies and presents 
a model for measuring complex geometry parts, manipulated through a robot arm, using a 
novel vision system consisting of a laser triangulation sensor and a motorized linear stage. 
First, the geometric model incorporating an automatic simple module for long term 
stability improvement will be outlined in the article. The new method used in the automatic 
module allows the sensor set up, including the motorized linear stage, for the scanning 
avoiding external measurement devices. In the measurement model the robot is just a 
positioning of parts with high repeatability. Its position and orientation data are not used 
for the measurement and therefore it is not directly "coupled" as an active component in 
the model. The function of the robot is to present the various surfaces of the workpiece 
along the measurement range of the vision system, which is responsible for the 
measurement. Thus, the whole system is not affected by the robot own errors following a 
trajectory, except those due to the lack of static repeatability. For the indirect link between 
the vision system and the robot, the original model developed needs only one first piece 
measuring as a "zero" or master piece, known by its accurate measurement using, for 
example, a Coordinate Measurement Machine. The strategy proposed presents a different 
approach to traditional laser triangulation systems on board the robot in order to improve 
the measurement accuracy, and several important cues for self-recalibration are explored 
using only a master piece. Experimental results are also presented to demonstrate the 
technique and the final 3D measurement accuracy. 
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1. Introduction 

In order to reduce time and costs while maintaining a good accuracy level there is a growing trend 
towards the use of measurement systems based on industrial vision for flexible automated 100% 
inspection of parts in sectors such as the automotive industry [1-5]. 

Within the group of industrial vision-based sensors, Light-Structured-Based systems (LSBs) are 
widespread for product geometrical inspection because of their accuracy and flexibility. LSBs systems 
are able to obtain 3D coordinates from a laser line projection on the measurement surface with high 
data acquisition speed and has been applied on the automotive, aeronautics and molds sectors, and 
applications related to heritage conservation and general measurements of industrial 
components [1-12]. Many types of LSB systems are available today, however the design of LSBs 
systems needs to take into consideration many factors such as accuracy, speed, working volume, 
reliability, and cost [1]. These factors often need to be carefully balanced for any particular 
application. There currently exists no industrial vision system capable of handling all tasks in every 
application domain. Only after the requirements in a particular application are specified, can the 
appropriate decisions for the design and development of such a system be taken. Nevertheless, the 
positioning and orientation ability between the scanning system and the measurement surface limit the 
scanning range. Different applications with this kind of devices mounted in measurement instruments 
as Coordinate Measurement Machines (CMMs) or Articulated Arm Coordinate Measurement 
Machines have been developed to solve range problems [13-19]. In particular, Laser Triangulation 
Sensors (LTSs) are nowadays the most commonly used non-contact sensors in traditional dimensional 
metrology and quality control tasks equipment. By combining an industrial robot and a LTS, flexibility 
and speed are provided to the measurement process [2,20-24] including in some cases external rotary 
axis [20]. 

Before using a robot and a LTS for measurement, usually two kind of calibration have to be 
performed. Firstly, the LTS calibration (intrinsic calibration) obtaining the relationship between the 
global frame of the camera (3D) and the frame of the projected image in the camera sensor (2D) [25]. 
The geometrical characteristics of the laser beam (a plane in this case) are obtained in the intrinsic 
calibration too. 

Secondly, obtaining the relative position between the global frame of the LTS, defined in the 
intrinsic calibration, and the global frame of the robot it is needed (extrinsic calibration). The LTS 
could be mounted in the end effector of the robot as a tool and the TCP (Tool Centre Point) calibration 
could be considered as a robot hand-eye calibration. Several authors propose solutions for the robot 
hand-eye calibration (equivalent to the extrinsic calibration when the LTS is mounted in the end 
effector of the robot) using linear [26-29] and non-linear solutions [30,31]. Other authors propose to 
grasp the part being verified with the robot and fix the LTS in the base frame [23]. 

This paper presents a high accuracy non-contact measurement system involving a novel sensor 
(LTS) mounted on a Motorized Linear Stage (MLS) for digitalize surfaces and a robot manipulator to 
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positioning different surfaces of the part in the field of view of the LTS allowing the scanning process. 
The model and calibration process of the system are described, as well as the proposed method for 
calculate and validate the movement direction of the MLS, which is needed for the surfaces 
reconstruction. Finally, the measurement model for the reconstruction of different surfaces in the 
global frame of the part is presented with the results of the test performed with a complex geometry 
part, in order to validating the measurement model. 

The calculation method for the movement direction of the MLS avoids external measurement 
devices, like a CMM or a Laser Tracker, measuring the position of the MLS in the global frame of the 
LTS unlike several methods proposed in the literature [13,32]. The method allows the LTS 
self-recalibration, using a gauge object, and enables the calibration performance on the inspection line. 

Another novelty presented in this paper is the measurement model developed for reconstructing 
different surfaces of the part in the global frame of the LTS without the robot positioning data, and so 
on, without the robot positioning inaccuracy. The presented model measures a master piece, as system 
initialization, to calculate de variation of the robot position for all the surfaces, taking advantage of the 
robot good positioning repeatability (a repeatability test is performed to verify the positioning 
repeatability) and avoiding the robot lack of accuracy and the extrinsic calibration performance. 

2. Sensor Design 

The specifications required for the application and a discussion about the need of the self-design of 
the LTS is pointed out firstly in this section. After that, the design of the LTS is analyzed and the 
devices that allow the scan of different part surfaces are shown. 

2.7. Specifications 

The design starting point of the LTS should be the definition of the measurement specifications. 
The characteristics of the elements to be measured and its tolerances are shown in Table 1 . 

Table 1. Specifications of the LTS. 



Characteristic 


Size 


Tolerance 


Surface Flatness 


110 x200 mm 2 


0.15 mm 


Diameter of holes in the surface 


6-20 mm 


0.2 mm 



The state of the art of the LSB systems has been widely reviewed in the literature [1-12]. There are 
a high number of laser triangulation probes available, but most of those are general purpose and their 
specifications do not fit with the ones required for the 100% flexible and automated 3D geometrical 
inspection of complex geometry parts with the characteristics and tolerances shown in Table 1 . A high 
precision sensor is needed but, the data acquisition velocity also has to be enough to allow the 
inspection of the 100% of the production. Although there are some sensors with the adequate 
precision, the data acquisition velocity of these sensors is not enough for the application. 

In order to obtain the adequate system, a specific LTS design is needed to ensure the correct 
inspection of parts combining relatively wide surfaces and small holes, all subject to tight tolerances. 
The selected components must meet some special features to suit with the specifications. For example, 
the laser illumination should generate a plane (a line in mage) instead of a line (a point in image) to 
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increase the data acquisition speed; and the spatial position of the hardware should be defined to 
improve the resolution of the sensor in the measurement of flatness and the position of the holes. 

2.2. Components 

The LTS is composed by two cameras, with a high resolution lens and an interferential filter each 
one, and a laser diode with a non-Gaussian laser line generator. Hardware characteristics are shown in 
Table 2. The LTS is mounted in a MLS allowing the digitalization of surfaces along the MLS travel 
range (250 mm). 



Table 2. Components list. 



Component 


Pes. 


Characteristics 


Camera 


2 


CMOS sensor 1024 x 1280 px. Selectable Region Of Interest, ROI (96 px 




in v coordinate). Frame rate 106 fps at selected ROI. 


Lens 


1 


High resolution lens for 2/3" sensors, focal distance/= 12 mm, minimum 


object distance MOD = 150 mm & F1.4-close. 6 h = 38°3', 6 V = 26°2\ 




1 


High resolution lens for 2/3" sensors, focal distance/= 35 mm, MOD = 




200 mm & F12.0-16. 6 h = 14°4', 6 V = 10°8\ 


Optic Filter 


2 


Interferential filter X c = 660 nm, bandwidth 20 + 2 nm. 


Laser 


1 


Laser diode generator, X = 660 nm, 5mW, Class II > 1 mW. 


Optic Pattern 


1 


Laser line generator with uniform (non-Gaussian) lengthwise. 

DC servo motor, travel range 250 mm, maximum speed 50 mm/s, 4,000 


Motion Linear Stage 


1 


pts/rev. encoder located directly on the screw resolution 0.5 |im, accuracy 

5 |im (typical 2.5 |im), uni-directional repeatability 1.5 |im. 

Six axis anthropomorphic robot, reach of 650 mm, payload of 5 kg. 


Robot manipulator 


1 


Repeatability 

< ±0.02 mm according with ISO 9283. Maximum speed 8.2 m/s. 



2.3. Geometry 

The spatial position and orientation of the optical elements affect the field of view of the system 
(Figure 1) and consequently, fixed the camera characteristics, affect the resolution too. The influence 
of the geometry of the LTS in these measurement characteristics has been studied to determine the best 
spatial configuration of the hardware, in order to manufacture a high precision stand to allocate the 
camera and the laser generator. 

The field of view in X axis defines the maximum width of the measurement and is calculated from 
the values Wd (working distance of the camera) and 0u (horizontal angle of the lens) (Equation 1): 



FV x =2.w d -tg 



(i) 



The field of view of the camera in Y and Z direction [shown in Figure 1(b)] can be calculated as the 
sum of Xj and X 2 components in Y and Z axis [Figure 1(c)]. Xj and X 2 can also be related with the 
geometrical parameters of the LTS as shown in Equations (2) and (3): 
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(3) 



The influence of a (angle between laser and the vertical) and j5 (angle between camera and the 
horizontal) in the field of view in Y and Z direction is analysed, once the working distance, is fixed 
from the initial specifications of the field of view in X direction and the lens characteristics (6j0, 
Figure 2. 



Figure 1. Influence of the geometrical parameters in the field of view of the LTS. (a) Field 
of view in X axis, (b) Field of view in Y and Z axis (c) Two components detailed 
decomposition of the field of view in Y and Z directions. 





(a) 



(b) 



(c) 



Figure 2. (a) Field of view Y coordinate [mm], (b) Field of view Z coordinate [mm]. 
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In order to obtain adequate resolution values in Y (to measure element position), and in Z (to 
measure surface flatness) directions, low field of view values are searched. 

A test with different a values has been performed. In this test is shown that high a values result in 
laser reflections in the wall of the hole and this effect generates localization inaccuracy (Figure 3). 
a - 20° is defined to avoid laser reflections and /? = a is assigned for minimize the field of view in Y 
and Z. 

Figure 3. Laser reflections in the wall of the hole, a = 70°. 




The assigned a ensures the laser light illumination in the limit edge between the wall of the hole 
and the bevel zone of the countersunk hole. This contour defines the hole position and diameter. In this 
conditions, a second camera (/? - 80°) is needed to capture the laser incidence on the contour as is 
shown in the reconstructed cloud points of the scanning test using different /? values, Figure 4. 

Figure 4. Scanned cloud points of a countersunk hole. The colour of the points indicate the 
distance to the surface in millimetres, (a) a= 20° & J3= 20°. (b) a= 20° & J3= 80°. 



C:\test-h\giradosvalidos.txt franja.txt 




(a) (b) 

The image resolution obtained with the devices final positions (a = 20°, Pi = 10° & = 80°) are 
shown in Table 3 according with the frame shown in Figure 1(a). 



Table 3. Resolution of the images [mm/pixel]. X, Y & Z directions are shown in Figure la. 



Device 


X resolution [mm/px] 


Y resolution [mm/px] 


Z resolution [mm/px] 


Camera 1 Image 


0.10 


0.05 


0.08 


Camera 2 Image 


0.02 


0.04 


0.11 
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2.4. Scanning & Part Positioning 

The motorized linear stage (MLS) allows the control of the LTS linear movement along the scan 
range and the position measurement for each captured image. A uniform mesh of points results from 
the digitalization. Points belonging to the surface and the contour of significant elements are identified 
and the measurement tasks are performed. The scan of plane surfaces is allowed by the MLS along its 
travel range (Table 2). 

The work piece is manipulated by a six axis robot. The robot handles the part in order to place the 
surface being measured in the field of view of the LTS. An initial master piece measurement provides 
the necessary information to calculate the position change of the robot. It allows the calculation of the 
position, in the global frame of the part, of the measured surfaces of the production parts without the 
robot positioning data. In this way, error sources from robot inaccuracy (generally high in robots) are 
avoided. The dimensions and geometry of the master piece are well-known from its measurement with 
a CMM. The robot positions in the initial measurement process with the master piece are the same as 
the robot positions in the measurement of the production parts. The robot brings flexibility to the 
system due to the high capacity of the robot to position a large number of different parts in the field of 
view of the LTS. 

3. Experimental Set Up and Validation 

The LTS should be calibrated and the system including the MLS and the LTS must be characterized 
in order to establish the relationship between the frame of the LTS and the movement direction of the 
MLS. A high precision gauge object is used to calibrate the LTS and relate it to the MLS. 

3.1. Characterization Gauge 

The characterisation gauge is a high precision object designed and manufactured to allow the 
calibration of the LTS mounted in the MLS and the validation of the scanning process. 

Figure 5. CAD model of the gauge object and measurement in MMC. 




The gauge materializes well known nominal coordinates points distributed on different planes for 
the LTS calibration (Figure 5). The edge of each flat surface allows the characterization of direction of 
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the MLS in the frame of the LTS. The frame of the LTS is defined by the calibration points of the 
gauge and it is equal to the frame of the gauge in the calibration position (CALI-LTS). The calibration 
target object allows the system validation by measuring the machined holes on its surface. 

A high precision numerically controlled machining centre has been used to machining the part in 
order to obtain the adequate geometrical precision. In any case, the diameter and position of the holes 
in the frame of the gauge has been measured with a CMM. 

3.2. Sensor Modelling and Calibration 

The ideal pin-hole model is used for modelling the cameras. Basically, the camera is modelled with 
a perspective transformation matrix (PTM). PTM is the change of base matrix (homogeneous matrix 
sized 4x4) needed to transform the known coordinates of a 3D point expressed in the global frame of 
the LTS into its correspondent 2D coordinates (u, v) in the local frame of the image [Figure (6b)]. 

Figure 6. (a) Picture of the calibration process, (b) Robot in calibration position and 
reference system in camera calibration, (c) Image taken for camera calibration 
(1280 x 96 px). (c) Image taken for laser calibration (1280 x 96 px). 



CALI-LTS = LTS 
global frame 



LTS local 
frame 




(c) 



(d) 



Camera and laser models and calibration techniques are well known and widely described in 
literature, for a detailed description of the PTM construction and LTS calibration see [13,14]. The 
PTM matrix components consist of the extrinsic parameters related to the CMOS sensor and the lens 
that define the local frame of the LTS originating in the lens optical centre, and intrinsic parameters 
that are the component of the transformation matrix relating the global frame of the LTS, defined by 
the gauge in the calibration, and the local frame of the LTS: 
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The equation of a straight line (5) connecting a point whose coordinates are known in the global 
frame of the LTS (X L ts Ylts Z L ts), and its correspondent image point projection with (u, v) coordinates 
in the frame of the image, could be written from (4): 
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(5) 



where my is the PTM component of the i th row and the j th column. 

Since the PTM is a non-invertible matrix, the straight line equation shown in (5) allows calculating, 
with the laser plane Equation (6) known in the global frame of the LTS, the 3D (X LT s Ylts Z LT s) 
coordinates of a point belonging to the laser line in image with (u,v) coordinates: 

cA X LTS + cB Y LTS + cC Z LTS + cD = 0; (6) 

In the calibration process (Figure 6) the global frame of the LTS is defined obtaining the PTM 
components with the gauge object [calibration points, Figure (6c)], applying linear techniques [33], 
and the laser plane equation is calculated [calibration planes, Figure (6d)]. After the calibration, a 
gauge object scanning in the calibration position is used to calculate the MLS movement direction in 
the global frame of the LTS (Section 3.3). 

Once the PTM is known, the coordinates of the calibration points in the image can be recalculated 
(ur, vr) on the basis of the known coordinates in the global frame of the LTS, as it is indicated in (7): 
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S'Vr 






= PTM 


K S > 









^ LTS 




^lts 
Zlts 




{ i j 





Up = 



Vp = 



C 3 



(7) 



Therefore, the error obtained in estimating the matrix parameters can be calculated by the difference 
between the initial point (u, v) and the recalculated (u R , vr). In order to verify the performed 
calibration, the image coordinates corresponding to the calibration points have been recalculated with 
mean error of 0.68 pixels for coordinate u and 0.095 for coordinate v for camera 1 and 0.45 pixels for 
coordinate u and 0.51 for coordinate v for camera 2. 

Once the LTS is calibrated the information provided from the camera (5) for each point of the laser 
line in image and the equation of the laser plane (6), allows writing a determinate system to solve (X LT s 
Ylts Z LT s) coordinates of the laser line points from its coordinates (u, v) in image (8): 



m n - m 3 1 • u m l2 - m 32 * u m l3 - m 33 • u 
in 2 1 - m 3 1 • u m 2 2 - rn 32 • v m 23 - m 33 • v 
cA cB cC 



^ LTS 




u — m 14 


Ylts 




V - /77 24 


\Z LTS J 




v -cD 



(8) 



3.3. Motorized Linear Stage Integration 



The MLS moves the LTS during the scan. The movement direction of the MLS slightly differs from 
Y direction of the global frame of the LTS and knowing the direction of the MLS in the global frame of 
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the LTS is critical for an accurate reconstruction of the points in image. Several applications use an 
external measurement device (such as a CMM or a Laser Tracker) to relate the movement direction of 
the MLS with the global frame of the LTS [13]. In this paper a new integration method to measure de 
movement direction using only the LTS itself, the MLS and the gauge object, avoiding external 
measurement devices, is presented. The results are validated and the calculated direction is applied to 
the measurement of different surfaces of the workpiece in the complete system test. 

Laser points in image are reconstructed and a translation T t = [x y z] ' is applied to each i-th point in 
order to obtain the surface digitalization. T t is the displacement of the LTS from the reference position 
(Po) to the position of the i-th image (9). The calibration position of the LTS is the initial reference 
position and is therefore a known position: 

cos(a) 



T ; = AL 



(9) 



cos(/?) 
cos(^) 

AL/ is the difference between the i-th MLS position (P t ) and the reference position data (Po) (10) 
and cos(a), cos(/?) and cos(^) are the director cosines of the MLS in the LTS global frame and 
therefore must satisfy (11): 

ALi=P r Po; (10) 
cos(a) 2 +cos(/?) 2 +cos(^) 2 =1; (11) 

The model for calculating the direction of movement is based in the fact that the edges of every flat 
surface in the gauge materialize the Y direction of the frame of the LTS, as the gauge remains in the 
calibration position, Figure 7. First, the gauge object is scanned in the calibration position. 1300 
images are obtained, including the image captured in the reference position and the i-th image in the 
position Pi (Figure 7). One of the corresponding points of one of the edges of the flat surface (u, v 
coordinates) is located through image analysis in the image captured in the reference position (Po). The 
point is reconstructed obtaining X 0 = [xo, yo, Zo\ expressed in the global frame of the LTS. 



Figure 7. (a) Scanning of the gauge for calculating the MLS direction, (b) Schematic 
detail of the Xi projection in the laser plane located at the reference position (Xj), the 
direction of the projection is the MLS direction. 




Gauge edge 



Y LTS directio 




MLS direction 



(a) 



(b) 
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If the location and reconstruction process of the points in the edges is repeated in each of the 1300 
images (image i captured in the i-th position P t and P t is AL to Po (10)), Xj 3D coordinates are 
obtained [x' ir y\ z'i\. Xj is the X t projection on the laser plane in position P 0 in the direction of 
movement of the MLS (12): 



X; - x\ +AL cos(a); 
v, = yV+AL-cos(/?); 
r = zV+AL cos( y); 



(12) 



As the located points in the 0 image and in the i-th image belongs to the same edge, and the edge is 
aligned with the Y direction (frame of the LTS), (13) must be satisfied: 

x 0 = Xiyzo = Zu (13) 
Finally, taken in consideration (9)— (13), equations system (14) could be written as: 



— - = cos(^); 
AL 

^ L = cos09); 
AL 

cos(a) 2 + cos(/?) 2 +cos(f) 2 =1; 



(14) 



From (14) the director cosines of the direction of movement of the MLS, expressed in global frame 
of the LTS, are obtained and the surface reconstruction is enabled. 

3.4. Validation 



The method explained in Section 3.3 is applied to the 1,300 images captured in the scanning of the 
gauge object. Sixteen edge points are available in each image captured with camera 1 (2 edge points 
are available in each image captured with camera 2) and (14) is applied for each point located in each 
edge for all the captured images. A director cosines mean value is calculated using the 1,300 images 
resulting 16 different values for camera 1 (one value for each edge) and 2 values for camera 2. 

Figure 8. (a) Reconstructed cloud points from the gauge digitalization using the selected 
director cosines, (b) Detail of the validation holes in the gauge. 
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In order to select the direction values with less accumulated error in the process, the distance 
between the validation holes is measured using each of the MLS directions calculated (Figure 8). In 
the reconstructed clouds of points the gauge holes are segmented and measured and the measurement 
results are compared with the measurement using a CMM. The direction selected is the one that 
minimizes the distance error between the centres measured using a CMM and the ones reconstructed 
with the LTS, Table 4. 



Table 4. MLS direction cosines obtained for each camera. 





cos(a) 




cos(y) 


Camera 1 


-0.003 


0.999 


-0.002 


Camera 2 


-0.004 


0.999 


-0.002 



To obtain the MLS direction with the camera 2, the same process as with camera 1 is followed 
using the camera 2 images. 

4. Operation Process 

Once calibration of the LTS has been performed with the captured images of the LTS -gauge, the 
points in the laser line are known in the global frame of the LTS and the part surfaces can be scanned 
(Figure 9) using a robot to positioning each surface in the field of view of the LTS (Figure 10). This 
section shows a method for measuring the different surfaces of the part and establishes the position of 
each element in the frame of the part avoiding using robot data. 



Figure 9. Scanning process. 




Figure 10. Positioning of the workpiece to measure each element. 
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The measurement process is divided in six stages: data acquisition, image analysis, reconstruction 
of the cloud points and analysis for each element of the part, coordinate system transformation to 
express point coordinates of each element in the reference system of the part and, finally, result 
analysis. This section is focused in the reconstruction of the cloud points and the coordinate system 
transformation to express point coordinates of each element into the global frame of the part. 

4.1. Surfaces Reconstruction 

As it is mentioned in Section 3, the displacement and the direction of the MLS has to be taken into 
account to an appropriate surface reconstruction from the laser line points of each image. For each 
point in image identified as a surface point, the coordinates in the frame of the LTS have to be 
calculated and after that, the translation T has to be applied as shown in (15): 



where: 

• Kij' *-th point of the j-th image; 

• Kij'' *-th point of the j-th image projection under the MLS direction in the laser plane in 
position P 0 . 

• Tf. defined in (12), MLS translation between the j-th position and the reference position P0 
expressed in the frame of the LTS. 

Before applying the model for the integration of the robot the cloud points of each scanned element 
appears along the LTS -MLS travel range in the scanning position (Figure 11). 

Figure 11. Different part surfaces reconstructed before the frame transformation to express 
each point coordinates into the global frame of the part (camera 1). 



4.2. Master Piece & Robot Integration 

In order to reduce the effect of robot errors the implemented method considers the use of a master 
piece, measured with a CMM, to obtain the transformation matrices of each local coordinate system, of 
each surface to be measured, to the global frame of the part (Figure 12). The initial measurement of a 
master piece avoids the use of the robot data to link the scanning point coordinates of the ft-th element 
with the global frame of the part. 




(15) 



z 
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Figure 12. (a) Elements local frames in the master piece, (b) Master piece end of pipe. 



FIXATION 
BRACKE1 




PART 
FRAME 

(PC) 




(a) 



The transformation matrix between the n-th element and the frame of the part could be written as 
(16) using the transformation matrix that links the frames in Figure 13(a), where the system is 
scanning the global frame of the part (robot position 0): 



1Y1 n 1V1 0,pc LTS 1V1 0,A6 1V1 n 



(16) 



Figure 13. Principal frames and transformation matrices used in the proposed model. The 
same pattern is applied to the serial piece substituting PC with pc & N with n. 
(a) Measurement of the element that materializes the global frame of the part, robot 
position 0. (b) Measurement of the rc-th element, robot position i. 





(a) 



(b) 



Equation (16) is a product of matrices where rame M Ro b 0 tPosition,FrameA, is a 4 x 4 homogeneous 
change of base matrix to transform the points coordinates known in the frame A into the frame B; the 
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robot position indicates if the measure element is the flange (position 0, e.g., ROB M 0 ,A6), where the 
global frame of the part is defined, or other element (position i with / = 1 to the number of elements to 
link with the global frame of the part); when no robot position is referred the values of M do not 
depend of the position of the robot end effector (e.g., R0B M LT s)- The frames involved in the developed 
method are shown in Table 5. 

Table 5. Principal frames used in the proposed method. 



Name 


Frame 


ROB 


Global frame of the robot. 


A6 


Local frame of the robot end effector. 


PC* or pc 


Global frame of the Part. 


N* or n 


Local frame of a part element. 


LTS 


Global frame of the LTS. 



* In capital letter refers to the master piece. 



In (16) LTS M 0 ,pc is calculated from the scanned cloud points but the other matrices are unknown. It is 
possible to write the same links for the measurement of another element with the robot in position i 
(17), Figure 13(b): 

* c M_=™MrL- ROB M7l- ROB M iA6 . A6 M_ 



(17) 



If the measured part is the master piece (16) and (17) could be written as (18) and (19): 

X=Xc'^'% 6 'X ; Robot position 0 (18) 

PC M N = LTS M^ PC ' ROB Mll s - ROB M i , A6 - A6 M N ; Robot position i ( 19 ) 

where the capital letters indicate that the elements (PC or N) belong to the master piece. 

Since the master piece is measured with a CMM, the transformation matrix between each element 
and the global frame of the part is known, PC M N . As it appears in Figure 12(b), a circular gauge with 
three holes is inserted in the pipe of the master piece to materialize a measurable local frame. LTS M 0 ,pc 
is calculated from the scanned cloud points, as LTS M 0 , pc in (16) and LTS M iyPC can be calculated (20): 

- S M- C =-M„.-M- (20) 

M iyN is obtained from the scanned cloud points. 
Grouping (18)-(20) the transformation matrices referred to the frames of the robot can be expressed 
as a known matrices product (21): 



ROB M -\ ROB M ROB M -\ ROB M LTS PC M LTS M -1 

1V1 LTS 1V1 0,A6 iV1 i,A6 LTS iV1 Q>,PC N lV1 i,N 



(21) 



The matrices in the right side of (21) are known and referred to the master piece measurement. 
The same equation development could be written for the remaining parts measurement (serial 
pieces) (22): 

ROB M -\ ROB M ROB M -\ ROB M LTS M pc LTS M -1 

LTS 1VI 0,A6 1VI i,A6 LTS 1VI 0,pc 1VI n 1VI i,n (22) 
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The left side of (22) is equal to the left side of (21) because the robot positions to measure each 
element of the master piece are the same that the ones used to measure the serial part, so pc M n can be 
calculated avoiding the robot data utilization (23): 

pc M = LTS M~ ] - LTS M - PC M - LTS M~ l - LTS M fvx\ 

lV1 n IV1 0,pc 1V1 0,PC 1VI N IV1 i,N lV1 i,n (23) 

The precision of the method depends on the robot repeatability because the same reached position is 
considered for the master piece and the rest of parts (serial pieces), so a repeatability test has been 
performed with the robot in order to evaluate the lack of repeatability effect in the measurement 
results. 

4.3. Robot Repeatability Test 

A repeatability test [34] has been performed at different speeds to reach points A and B shown in 
Figure 14. The distance between A and B was 300 mm and 20 iterations where made positioning the 
robot at each point. A laser tracker was used to measure the reached positions. For the speed tested the 
positioning repeatability results remain under 6 \im. Trials were carried out with the tracker 
retroreflector in the center and the periphery of the support of the robot, giving repeatability of the 
order of the previous ones and therefore lower orientation errors. 

Figure 14. Repeatability test, (a) Laser tracker and robot during the test, (b) Schematic 
situation of points A and B. (c) Repeatability test results: distance between the position 
reached in each iteration and the mean position calculated with the twenty iterations. 



(a) (b) 




0 5 10 15 20 0 5 10 15 20 
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The repeatability value obtained from the test, indicate an acceptable effect of the robot positioning 
repeatability in the measurement results. 

5. Test and Results 

Precision has been studied using a reference part. This was a heat exchanger with several elements 
to be verified, set in various positions and orientations, as shown in Figure (12a). The conditions in 
which the test took place were similar to those found when measuring parts in industrial facilities. The 
image and 3D cloud points processing software have been developed in order to work correctly with a 
variety of components other than the reference part. However, it should be pointed out that the system 
behavior is highly sensitive to the features of the measured surfaces, their reflectivity, and the contour 
of the location elements (round or countersunk holes), and that variations in such characteristics have 
been taken into account. 

The flatness of the flange and the fixation bracket are checked with the camera 1. With the camera 2, 
the position of the mounting hole of the fixation bracket and the end of the pipe is verified. The 
dimensions of the flange are 125 x 96 mm of flat surface with holes and windows for the circulation of 
fluids and fastening the exchanger. The size of the fixation bracket is 45 x 28 mm, and it has an 
1 1 mm-long and 5 mm radius mounting hole at its center. Thus, position of the center of this mounting 
hole is measured. And finally, the diameter of the end of the tube is 16 mm. 

The system accuracy has been studied by measuring the reference part ten times and analyzing the 
variation in the results regarding their mean value. The digitalization results for several such iterations 
are shown superimposed on Figure 15. Accuracy was studied by comparing the results of the 
measurement system with the results when measuring the same characteristics of the part using a 
CMM. 



Figure 15. Several iterations reconstructed. 




In order to evaluate the system measuring diameter of holes, position of components, and so on, 
different representative parameters are selected. Camera 1 checks the flatness of the surfaces and the 
representative parameter, flatness in this case, will be used to evaluate the accuracy and repeatability 
of the system. The theoretical plane is calculated as that fitted by the object points (flange or fixation 
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bracket) by means of least squares. As well as precision, it is possible to perform qualitative analysis 
of the flatness inspection, based on the representation of the distance from the theoretical plane of each 
object points using a color scale. 

Once the iterations have been carried out, and after analyzing the measurement images and the 
digitalized points, the flatness results shown in Figure 16 are obtained for the flange. As mentioned 
above, the distance from the theoretical plane of each point on the flange is represented by a color 
scale. This distance is calculated using the Robot-MLS-LTS integrated system, and next it can be 
appreciated the distance between each point and the plane as measured using a CMM and the same 
color scale. 



Figure 16. Distance from the theoretical plane of the points of the measured flange, 
(a) Points digitalized with the Robot-LTS system, (b) Contact probed points in the CMM. 

ROBOT-LTS-MLS CMM 




(a) (b) 

Similar results are obtained for the fixation bracket. The coordinates of the reconstructed points of 
each element expressed in the global frame of the part are graphed in Figure 17. 



Figure 17. Reconstruction of the scanned cloud points in the global frame of the part, 
(a) Camera 1 scanning, (b) Camera 2 scanning. 




(a) (b) 
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Analyzing the results obtained by measuring ten times the reference part, the following indicators 
for the characteristics uncertainties for different kind of measures can be concluded: 

• Flatness: 0.020 mm 

• Position/diameter in the same item: 0.030 mm 

• Position between other items: 0.060 mm 

These values have been calculated according with the GUM [35] using a confidence level of 95% 
(k = 2). Finally, the process takes 20 s for the data acquisition and 4 s for the complete data analysis of 
the final results. 

6. Conclusions 

This article presents the design analysis, model and test of a novel sensor based in laser 
triangulation using two cameras. The scanning process is carried out by a motorized linear stage on 
which the sensor is mounted. Using a robot to positioning different part surfaces within the field of 
view of the sensor, allows the surfaces measurement expressing the results in the global frame of the 
part. A method for the calculation of the direction of movement of the motorized linear stage in the 
global frame of the part has been developed and validated with a gauge object. The method avoids the 
direct direction measurement by external devices simplifying the measurement system set up and 
allowing the self recalibration system on the inspection line. 

The measurement model developed takes the robot as a positioning element and uses a master piece 
of known dimensions to set the relative positions of the robot in the measurement of each surface. This 
model takes advantage of the robot flexibility avoiding its inaccuracy. Test results confirm the 
accuracy and repeatability of the complete system for measuring different components and 
characteristics of a reference model, with appropriate repeatability values for checking complex 
geometry parts and adequate cycle time to allow the 100% production inspection. 
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